

REC'D 1 6 MAR 2005 











Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Bescheinigung Certificate 



Attestation 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprunglich eingerejchten 
Fassung der auf dem nach- 
sten Blatt bezeichneten 
europaischen Patentanmel- 
dung uberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initlalement deposee de 
la demande de brevet 
europeen specif iee a la 
page suivante. 



Patentanmeidung Nr. Patent application No. Demande de brevet n' 

04300019-9 >/ 



PRIORITY 
DOCUMENT 

SUBMITTED OR TRANSMITTED IN 
COMPLIANCE WITH RULE 17.1(a) OR (b) 



Der Prasident des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Office europeen des brevets 
p.o. 




R C van Dijk 



EPA/EPO/OEB Form 1 01 4. 1 - 02.2000 7001 01 4 




i 



Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Anmeldung Nr: 
Application no.: 
Deinande no: 



04300019.9 ^ 



Anmeldetag: 
Date of filing: 
Date de d^pot: 



13.01.04 



Anmelder/Appl 1cantCs)/DeinandeurC s) : 

Koninklijke Philips Electronics N.V. 
Groenewoudseweg 1 
5621 BA Eindhoven 
PAYS-BAS 

Bezeichnung der Erf 1 ndung/Tl tl e of the 1 nvent1on/Ti tre de 1' Invention: 
(Falls die Bezeichnung der Erflndung nicht angegeben ist, slehe Beschrelbung. 
If no title Is shown please refer to the description. 
SI aucun titre n'est indlqud se ref erer a la description.) 

Mesh models with internal discrete elements 

In Anspruch genommene Pr1or1at(en) / Priori tyCles) claimed /Pr1or1t6(s) 
revendl qu^e( s) 

Staat/Tag/Aktenzelchen/State/Date/Flle no./Pays/Date/Num^ro de d^pot: 



Internationale Patentklasslflkatl on/International Patent Classification/ 
Classification Internationale des brevets: 



Am Anmeldetag benannte Vertrag staa ten/Con tracti ng states designated at date of 
flHng/Etats contractants d^slgn^es lors du d^pot: 



AT BE BG CH GY CZ DE DK EE ES FX FR GB GR HU IE IT LU MC NL 
PT RO SE SI SK TR LI 



G06T/ 



04300019.9 
EPA/EPO/OEB Form 1014.2 - 01.2000 



2 



7001014 



PHFR040007 EPp 



1 



"MESH MODELS WITH INTERNAL DISCRETE ELEMENTS'* 
Description 

Field of the Invention 

The invention relates to an image processing system having image data 
processing means for the segmentation of an object of interest in a two- 
dimensional or in a three-dimensional image, comprising an operation of mapping 
a deformable mesh model onto said object of interest. The invention further 
relates to a medical examination apparatus for producing medical two- 
dimensional or three-dimensional images to be processed by the processing 
system, for the segmentation of objects such as body organs, or body fluid flow, 
in order to study or detect abnormalities or pathologies. The invention finds a 
particular appKcation in the field of medical imaging methods, program products 
and apparatus or systems. 

Background of the Invention 

In three-dimensions, tetrahedral meshes, i.e. volumetric meshes composed 
of tetrahedrons, are mainly used for modeluig a physical quantity in three- 
dimensional objects such as blood flow in vascular system. The adaptation of the 
shape of the mesh elements is essential because it highly influences the precision 
and stability of the computation. The ideal element shape is a regular tetrahedron 
having equilateral faces and same edge length. 

The tetrahedral meshes are created firom surface meshes composed of 
triangles. The triangle mesh is a description of the surface of the 3D object, while 
the tetrahedral mesh is a description of the volume within the same 3D object 
Both types of meshes share the same surface triangulation. 

The generation of tetrahedral meshes is mainly based on the so-called 
Delaunay Tetrahedrization method. The Delaunay method is for instance 
disclosed in the publication entitled "Reasonably efficient Delaxmay based mesh 
generator in three dimensions" by H. Borouchaki, F. Hecht, E. Saltel and P. L. 
George, dated August 23, 1995 (INRIA, Domaine de Rocquencourt, BP 105, 
78153 Le Chesnay Cedex FRANCE, EUROPE). 
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According to this method, tetrahedral elements are created by 
incrementally inserting new vertices according to the Delaunay criterion, inside 
tetrahedrons that have to be refined The method starts with a mesh surface, 
whose mesh is composed of triangles, and further generates a rough volumetric 
mesh, with tetrahedrons having common vertices with the vertices of the surface 
meshes. Then, this volumetric mesh is incrementally refined using the Delaunay 
approach until an optimal element size is obtained. 

The issue is how to define elements actually showing optimal shapes and 
sizes. A quick and simplistic solution is to give the same size to each tetrahedral 
elements of the volumetric mesh. However, this approach is very limited, because 
it does not take into account local size variation of the surface triangular meshes, 
which can lead to ill-shaped volumetric elements. 

Summary of the Invention 
The object of the invention is to provide an image processing system 
comprising image data processing means to carry out a fully automatic method, 
which is able to generate either a volumetric mesh model in a 3D image or an 
intemal mesh model in a 2D image. This volumetric mesh model is composed of 
tetrahedral elements that are created firom surface meshes composed of triangles, 
and which automatically dynamically adapts the tetrahedral element size 
according to the local variation of size of the surface triangles. The intemal mesh 
model is composed of triangular elements created from contour meshes composed 
of segments, and which automatically adapts the triangular elements to local 
variation of size of the contour segments. The volumetric tetrahedral element and 
the intemal triangle elements are further called discrete intemal elements, while 
the surface triangle elements and the contour segment elements are called discrete 
surface elements. 

The object of the invention is to propose an image processing system 
comprising image data processing means to estimate mesh quality of the discrete 
intemal elements. According to the invention, the mesh model is refined by 
insertion of new vertices inside said discrete intemal elements. The system of the 
invention comprises processing means for refinement of the process including: 

means for acquiring size information defined by the discrete 
surface elements in order to evaluate the optimal size to be assigned to the discrete 
intemal elements; and 
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means for propagating this size information from the discrete 
surface elements to the discrete internal elements while new discrete internal 
elements are created during the refinement process. 

It is also an object of the present invention to propose an image 
processing method with steps for operating this system. The invention also relates 
to a medical diagnostic imaging apparatus coupled to this system for 3-D image 
processing. The medical imaging apparatus may be a MRI medical examination 
apparatus or an X-ray medical examination apparatus or any other 3-D medical 
imaging apparatus. The invention further relates to a program product or a 
program package for carrying out the image processing method. 

Brief description of the Drawings 
The invention is described hereafter in detail in reference to the following 
diagrammatic and schematic drawings, wherein: 

FIG.IA and FIG. IB shows diagrammatic representations of the means of 
flie system of the invention for modeling an object respectively with a volumetric 
mesh model and with a surface mesh model; 

FIG.2A, FIG.2B, FIG.2C and FIG.2D illustrate different possibilities of 
vertex insertion for refining tetrahedrons in a volumetric deformable mesh model, 
among which FIG.2A illustrates the option of inserting a vertex at the middle of 
an edge; FIG.2B illustrates the option of inserting a vertex at the center point of a 
of a triangular face of the tetrahedron; FIG.2C illustrates the option of inserting a 
vertex at the center pomt of the tetrahedron; FIG.2C illustrates the option of 
inserting a vertex at the center point of the circimi-sphere of the tetrahedron; 

FIG.3A, FIG.3B and FIG.3C illustrate the application of Delaunay's 
criterion for refining meshes, among which FIG.3A illustrates the determination 
of the weight of a vertex; FIG.3B and FIG.3C illustrate the insertion of a vertex in 
a triangle; 

FIG.4A represents a segmented contour of a 2D object; FIG.4B represents 
2D discrete internal elements constracted from the contour and FIG.4C represents 
refined 2D discrete internal elements; 

FIG. 5 A shows a segmented surface of a 3D object where the surface mesh 
is formed of a set of triangles; FIG.5B shows the volumetric mesh model 
constructed with rough tetrahedrons, whose vertices are those of this surface mesh 
model; FIG.5C shows this volumetric mesh model, whose tetrahedrons are refined 
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according to the invention, and formed of smaller tetrahedrons adapted to the 
triangles of the surface; 

FIG.6A shows a segmented surface where the surface mesh is formed of 
another set of triangles; FIG.6B shows a segmented volume where the volumetric 
mesh is refined according to the invention, and formed of smaller tetrahedrons 
that are adapted to these other triangles of the surface; 

FIG.7 illustrates a medical viewing system coupled to a medical 
examination apparatus. 

Detailed Description of Embodiments 
The invention relates to the improvement of medical images reipresenting 
an object of interest to be studied. The object of interest may be a blood vessel, 
such as the Abdominal Aorta, for studying Abdominal Aortic Aneurisms (AAA), 
represented in two-dimensional or in three-dimensional medical images. 

These images may be used for the study and detection of cardiovascular 
diseases by means of a patient-specific computation fluid dynamic (CFD) 
simulation of the blood flow and the short- and long-term reaction of the vascular 
system to this flow. In this context, the CFD simulations consist in modeling by 
finite-element method (FEM) the geometrical and the mechanical information 
about the vessel components. The geometrical information will come fi-om the 
segmentation of the medical image in the form of three-dimensional surface 
meshes (voxel classification). For the FEM, a mandatory step is the tessellation of 
surface meshes into volume meshes composed of finite volume elements. This 
operation is called volvune mesh generation. 

In three dimensions, the finite volxntie elements are usually of two possible 
types, called tetrahedral and hexahedral types, each of them being represented as a 
set of points and connections between these points. 

In the case when the finite volume elements are of the hexahedral type, a 
type of volume mesh model, called structured mesh, is associated to the element 
type. A structured mesh consists of a set of points and regular connections (i.e 
constant adjacency number, for example always three adjacent elements, no more, 
no less) at each point. 

The present invention does not relate to the possible shape known as 
hexahedral shape. Instead, according to the invention, the finite volmne elements 
are of the tetrahedral type. In the case of the tetrahedral type, a type of volume 
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mesh model, called unstructured mesh, is associated to the element type. The 
comiections of each pomt are not regular (for example the number may vary; three 
or four or five or more adjacent elements may be found). 

An advantage of unstructured meshes is their flexibiUty that allows 
tetrahedral elements to fit irregular boundaries with a good accuracy. Another 
advantage of unstructured meshes is that they can be automatically generated* 
Another advantage of unstructured meshes is their ability to satisfy mesh 
adaptation requirement Indeed, it is often required that the mesh be controllable 
in order to allow a trade-off between accuracy and calculation time. In this case, 
the element density must vary depending on local accuracy requirements and this 
variation must be smooth. This is called mesh adaptation. With unstructured 
elements, the variation of element size and density can be controlled because the 
connectivity is not constrained. For tetrahedral elements, the best precision in 
calculation is obtained with regular tetrahedrons. In order to guaranty a sufficient 
accuracy, the mesh must satisfy an optimum, for instance minimum, of a quality 
criterion that measiues the geometric shape quality of its elements. 

The present iavention relates to a first embodiment of an image processing 
system for automatically segmenting an object of interest represented in a three- 
dimensional image, using a three-dimensional discrete Deformable Volumetric 
Mesh Model. The Surface S of the Volimaetric Mesh Model of segmentation is 
fitted onto the siurface of said three-dimensional object and the volumetric meshes 
V of the Model are adapted to the meshes of the surface S. According to the 
invention, tetrahedral meshes, i.e. volumetric meshes composed of tetrahedrons, 
are created from surface meshes composed of triangles. The triangle mesh is a 
description of the surface of the 3D object of interest, while the tetrahedral mesh 
is a description of the volume within the same 3D object. Both types of meshes 
share the same surface triangulation. The ideal element shape is the regular 
tetrahedron with equilateral faces and same edge length. 

The present invention further relates to another embodiment of the image 
processing system for segmenting an object of interest represented in a two- 
dimensional image, using a two-dimensional discrete Deformable Mesh Model. 
This system comprises means whereby segments of an Outline S of the 
Deformable 2D Mesh Model of segmentation are fitted onto the boundary of said 
object in the 2D image, and triangular meshes V internal to the Outline are 
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adapted to the size of the segments of the Outline. The object of interest may be a 
cross-section of an organ represented in a two-dimensional medical image. 

According to the invention, the triangular meshes, i.e. internal meshes V of 
the Outline S, are created from the Outline composed of segments. The segmented 
Outline mesh is a description of the surface of the 2D object of interest 
represented in a 2D image, while the 2D area composed of triangular meshes is a 
description of the region within the Outline of the same 2D object. The ideal 
intemal element shape is the equilateral triangle. 

In fact, the invention has means to solve the same problem in tree- 
dimensional images or in two-dimensional images. The present invention 
proposes an image processing system having image data segmentation means for 
automatic optimisation of the size of discrete intemal elements with respect to the 
segmented contour of surface of an object. These discrete intemal elements are 
either 3D tetrahedrons with respect to a 3D segmentation surface formed of 
triangles, or 2D equilateral triangles with respect to a 2D segmentation contour 
formed of segments. 

A first embodiment is described for modeUng a 3D object using a 
volumetric mesh model. FIG.IA is a diagrammatic representation of the means of 
the system of the invention relating to this first embodiment. Images processed 
according to the invention are shown in FIG.5A to FIG.SC and FIG.6A, FIG.6B. 
FIG.5A represents a surface mesh S of a sphere composed of triangles and 
FIG.5B represents an initial volumetric mesh V of the same sphere, both images 
being clipped to a plane P ia order to see inside the sphere. The segmentation 
surface S formed of triangles is first made available. From said surface mesh S of 
the 3D object, an initial tetrahedral mesh V of the same object is created. All the 
vertices of the tetrahedrons of the initial volumetric mesh V are vertices of 
triangles of the surface S. Thus, the tetrahedral elements are all connected to the 
surface of the object. As illustrated by FIG.5B, this volumetric mesh has very flat 
tetrahedral elements, which results in poor shape quality of the tetrahedrons, and 
presents a large variation in tetrahedron sizes and volumes. 

Referring to FIG.IA, the automatic system of the invention first comprises 
data processing means for automatically and dynamically constructing an 
unstructured volumetric mesh model, including: 
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1) Computing means lA for creating the discrete surface elements of the 
3D segmentation surface S, which are formed of triangles Tj defined by their 
vertices on S, adjacent by their edges, as illustrated by FIG.SA; 

2) Computing means 2A for creating the initial volumetric elements V, 
which are tetrahedrons denoted by THj, whose four vertices are vertices of S: this 
ensues that such tetrahedrons may be very flat, as illustrated by FIG.5B, which is 
the reason why they are called rough. 

The automatic system also comprises computing means for refining the 

initial volumetric elements, including: 

estimation means 3 A for acquiring size information of the 

surface elements; 

estimation means 4A, 5A to evaluate the optimal size to be 
assigned to the volumetric elements THj of V, using the size information related 
to the surface elements Tj of S; and 

refinement means 6A to lOA for propagating this size 
information from the surface S to the volume V while new volumetric elements 
THj are created during the refinement process. 

According to the invention, the volumetric elements are refined by 
insertion of new vertices inside the initial volumetric elements, taking the size 
information of the surface elements into account. Referring to FIG.IA, these 
refming processing means may favourably comprise in detail: 

3) Processing means 3 A for defining a weight parameter Lj assigned to 
each vertex of the discrete elements: Referring to FIG.3A, which represents a set 
of discrete elements, for each vertex of the set, for example for the vertex B, the 
different lengths of the edges joining said vertex to its neighbor vertices is 
calculated, for example the lengths of segments BA, BK, BG, BF, BE, BC, BD, 
and denoted by distances Lj. Then, the weight parameter, called optimal distance 
Lj, is calculated for B, and further for the other vertices J of the set of discrete 
elements. The weight parameter is favorably the average value of the different 
distances Lj related to B, and then to said other vertices J. This opemtion of 
calculating the weight parameter Lj to be assigned to a vertex J is applied in 3D to 
the vertices of the initial volumetric elements represented by the rough 
tetrahedrons THj of FIG.5B forming V, said vertices all being on the surface S of 
segmentation formed of triangles Tj. 
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4) Processing means 4A for calculating an optimal volume vj associated 
to each tetrahedral element THj. The initial tetrahedral elements in 3D are based 
on the vertices of the respective 3D surface mesh. In 3D, the tetrahedral elements, 
THj, are based on four vertices of the 3D surface S, each vertex being assigned the 
respective weight parameter formed by the optimal distance Lj previously 
calculated. Assigning said distance Lj to the vertices of the mesh V is possible 
since the surface mesh S and the volume mesh V share the same surface 
triangulation. The optimal element shape being the regular tetrahedron, the 
optimal volume vj is the volume of a regular tetrahedron with edge lengths equal 
to the average of the 4 optimal distances Lj of the vertices composing the element 
The volume vj may be given by the following formula (la): 

^j- g (la) 

5) Processing means 5A for calculating the real volume vrj of each initial 
tetrahedral element. 

6) Processing means 6A for comparing the real volume vrj and the 
optimal volume Vj; and accordingly, to initiate a refinement of the tetrahedron THj 
under study: 

a) if the real volxmie vrj of a tetrahedron THj is bigger than its 
optimal volume vj, according to the invention = operating refinement of the 
tetrahedral element under study, using further processing means 7A; otherwise: 

b) skipping to an other tetrahedron of the volume V; and 

c) if or when there are no more tetrahedrons to refine, stop refining; 

7) Processing means 7A for selecting several location of vertex insertion 
in a tetrahedron whose real volume vrj is bigger than the optimal volimie vj. For 
inserting a new vertex, some possible locations are: 

at the middle of one of its edges as illustrated by FIG.2A; 
at the middle of one of its faces as illustrated by FIG.2B; 
at the center of the tetrahedron as illustrated by FIG.2C; or 
at the center of the circum-sphere as illustrated by FIG.2D. 

8) Processing means 8A for calculating the parameter called optimal 
distance Lj to be assigned to the newly inserted vertex depending on the chosen 
location. If the chosen location is: 
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at the middle of one of its edges (FIG.2A): the optimal distance to 
assign to the new inserted vertex is the average of the 2 optimal distances 
previously calculated and assigned to the 2 vertices at the extremities of the edge; 

at the middle of one of its faces (FIG.2B): the optimal distance to 
assign to the new inserted vertex is the average of the 3 optimal distances 
previously calculated and assigned to the 3 vertices of the face; 

at the center of the tetrahedron (FIG.2C): the optimal distance to 
assign to the new inserted vertex is the average of the 4 optimal distances 
previously calculated and assigned to the 4 vertices of the tetrahedron; 

at the center of the circum-sphere (FIG.2D): the optimal distance is the 
average of the 4 optimal distances of the 4 vertices of the tetrahedron. 

9) Measure means 9A for calculating a tetrahedron shape quahty measure 
q, based on the shape of each tetrahedron in order to evaluate and compare the 
shapes provided by each option of inserting vertex. In order to estimate the 
differences between the four possibilities of inserting a vertex in a tetrahedron as 
presented above, a first possible criterion is given by the following formula: 



where p is the diameter of the inscribed sphere of the tetrahedral element and h is 

the length of the largest edge of the tetrahedral element. 

Another simple criterion for the shape quality q may be: 



where p is the diameter of the sphere that is inscribed into the tetrahedron and d is 
the diameter of the circimi-sphere. The location of insertion that will give the best 
quality of the worst element created is kept. 

10) Processing means lOA for refining the mesh by insertion of the new 
vertex at chosen location. Refining tetrahedrons permits of propagating the 
optimal size information inside the volimae and creates several smaller 
tetrahedrons for replacing an mitial tetrahedron. While creating tetrahedrons, also 
Delaunay validity criterion is applied. 

The Delaunay validity criterion is explained hereafter: A tetrahedron is 
so-called "Delaunay valid" if and only if its circum-sphere, i.e. the sphere defined 



qj 



p 

h 



(2a) 




(3a) 
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by the 4 points of the tetrahedron, encloses no other point of the mesh. By 
extension, the mesh is Delaunay valid if and only if every mesh elements are 
Delaunay valid. This criterion is illustrated by FIG3B and 3C, in relation to a 2D 
image; A new vertex O is inserted in a triangle ACD. However, this new vertex is 
inside the circimi-circle 4>1 of triangle ABC and the circmn-circle <&3 of triangle 
CDB. Hence, segments AC and CD must be suppressed and new segments OA, 
OB, OC, OD, OE are created. This permits of creating new triangles AOB, BOC, 
COE, DOE, AOD, 

FIG.3B and FIG.3C show how a new point is inserted in a 2D triangular 
mesh, the process extends in 3D in the same way. Each newly inserted vertex 
needs to be connected to the mesh. To connect the point, one first locates every 
tetrahedron for which the circum-sphere overlaps the point, i.e. not Delaimay 
valid anymore and remove them from the mesh. This defines the enclosing 
convex cavity, as illustrated in 2D by FIG.3C. Then, a new construction of 
tetrahedron is performed by connecting point to the cavity faces. 

Hence, using the processing means of the invention, a fully automatic 
method is applied, which dynamically adapts the tetrahedral element size 
according to the local variation of size of the surface triangles. 

The means of the invention are fully appropriate to be applied to 2D 
images. A second embodiment is described for segmenting a 2D object using a 2D 
defoimable mesh model. FIG. IB is a diagrammatic representation of the means of 
the system of the invention relating to this second embodiment. The 2D 
segmentation is illustrated by FIG.4A to FIG.4C. As illustrated by FIG.4A, an 
object of interest is segmented according to a contour mesh S formed of segments 
ESj. From said contour mesh S of the 2D object, an initial internal 2D mesh V of 
the same object is created with triangles denoted by ITj. All the vertices of the 
triangles of the initial internal 2D mesh V are the vertices of segments of the 
contour S. Besides, this initial intemal set of triangles V contains no other vertices 
than the vertices of the contour mesh S. Thus, the triangles ITj are all connected to 
the contour of the object. As illustrated by FIG.4B, the result is quite rough. Since 
all vertices of V are also vertices of S, this intemal mesh has triangular elements 
whose shape is very far from the equilateral shape, which results in poor shape 
quality of the mesh. 
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Referring to FIG. IB, the automatic and dynamic system of the invention 
jHrst comprises data processing means for automatically constructing a 2D contour 
mesh S and internal discrete elements V. these means are comparable to the 
means of FIG. 1 A, including: 

1) Computing means IB for creating the 2D discrete contour elements S, 
which are formed of segments ESj defined by their vertices A*, B*, C*,. . K' on S, 
adjacent by their edges, as illustrated by FIG.4A; 

2) Computing means 2B for creating the initial internal discrete elements 
V, which are triangles Uj, whose three vertices are vertices of S, such as A'B'D*, 

as illustrated by FIG.4B; 

Computing means 3B to 1 IB for refining the initial intemal elements, 

including: 

estimation means 3B for acquiring size information of the contour 

elements; 

computation means 4B, 5B, using the size information defined by 
the contom: elements of S to evaluate the optimal size to be assigned to the 
discrete intemal elements of V; and 

refinement means 6B to 1 IB for propagating this size information 
from the contour S to the intemal region V while new intemal elements are 
created during the refinement process. 

According to the invention, the intemal elements are refined by insertion 
of new vertices inside the initial triangular elements, taking the size information 
of the contour elements into account. As illustrated by FIG. IB, these refining 
processing means may favourably comprise in detail: 

3) processing means 3B for defining a weight parameter Lj assigned to 
each vertex of the segmented contour S. 

4) Processing means 4B for calculating an associated optimal surface sj 
associated to each triangular element ITj. In 2D, the triangular elements, denoted 
by ITj , are based on three vertices of the 2D contour S, each vertex being 
assigned the respective weight parameter formed by the optimal distance Lj 
previously calculated. The optimal element shape being the regular triangle, the 
optimal surface sj is the surface of a regular triangle with edge lengths equal to the 
average of the 3 optimal distances Lj of the vertices composing the element. 
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5) processing means 5B for calciilating the real area srj of each initial 
triangular element; 

6) processing means 6B for comparing the real area Srj and the optimal 
area sj; and accordingly, to initiate a refinement of the triangle ITj under study: 

a) if the real area srj of a triangle ITj is bigger than its optimal 
surface sj, according to the invention = operating refinement of the triangle 
element under study, using further processing means 7B; otherwise: 

b) skipping to an other triangle of the internal region V; and 

c) if or when there are no more triangles to refine, stop refming; 

7) processing means 7B for selecting several location of vertex insertion in 
the triangle whose real area srj is bigger than the optimal area sj. For inserting a 
new vertex, some possible locations are: at the middle of one of its edges, at the 
centre of the triangle or at the centre of the circum-circle. 

8) processing means 8B for calculating the parameter called optimal 
distance Lj to be assigned to the newly inserted vertex depending of the chosen 
location. If the chosen location is: 

at the middle of one of its edges: the optimal distance to assign to 
the new inserted vertex is the average of the 2 optimal distances previously 
calculated and assigned to the 2 vertices at the extremities of the edge; 

at the middle of the triangle: the optimal distance to assign to the 
new inserted vertex is the average of the 3 optimal distances previously calculated 
and assigned to the 3 vertices of the triangle; 

at the center of the circum-circle. 

9) Measvure means 9B for calculating a triangle shape quality measure q in 
order to evaluate and compare the shapes provided by each option of inserting 
vertex, 

10) Processing means lOB for refining the mesh by insertion of the new 
vertex at chosen location. 

Hence, using the processing means of the invention, a fiilly automatic 
method is applied, which dynamically adapts the triangular element size 
according to the local variation of size of the contoiu: segments. 
Medical examination apparatus and viewing; system 

The above-described means are included in or coupled to the viewing 
system of the invention, Fig.7 shows the basic components of an embodiment of 
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an image viewing system in accordance to the present invention, incorporated in a 
medical examination apparatus. The medical examination apparatus 100 may 
include a bed 110 on which the patient lies or another element for localizing the 
patient relative to the imaging apparatus. The medical imaging apparatus 100 may 
be a CT scanner or other medical imaging apparatus such as x-rays or ultrasound 
apparatus. The image data produced by the apparatus 1 00 is fed to data processing 
means 70, such as a general-purpose computer, that comprises computation means 
and user control means appropriate to form the interactive adaptation means of the 
invention. The data processing means 70 is typically associated with a 
visualization device, such as a monitor 60, and an input device 72, such as a 
keyboard, or a mouse 71, pointing device, etc. operative by the user so that he can 
interact with the system. The data processing device 70 is programmed to 
implement the processing means for processing medical image data according to 
invention. In particular, the data processing device 70 has computing means and 
memory means necessary to perform the operations described in relation to FIG. 1 
and FIG.4. A computer program product having pre-programmed instmctions to 
carry out these operations can also be implemented. 

The drawings and their description herein before illustrate rather than 
limit the invention. It will be evident that there are numerous alternatives that fall 
withia the scope of the appended claims. Moreover, although the present 
iQvention has been described in terms of generating image data for display, the 
present invention is intended to cover substantially any form of visualization of 
the image data including, but not limited to, display on a display device, and 
printing. Any reference sign in a clakn should not be construed as limiting the 
claim. 
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Claims 

1 . An image processing system having image data processing means of 
segmentation of an object of interest using an imstructured defonnable mesh 
model composed of surface discrete elements and internal discrete elements, and 
further comprising means of refining the unstructured defonnable mesh model by 
automatically dynamically adapting the size of the internal discrete elements 
according to the local variation of size of the surface discrete elements. 

2. The image processing system of Claim 1 , fixrther comprising image data 
processing means for acquiring size information related to the sxirface discrete 
elements in order to evaluate the optimal size to be assigned to the internal 
discrete elements, and for propagating this size information from the surface 
discrete elements to the internal discrete elements while new internal discrete 
elements are created during the refinement process. 

3. The image processing system of Claim 2, wherein new intemal discrete 
elements are created during the refinement process by insertion of new vertices 
inside said intemal discrete elements, 

4. The image processing system of Claim 3, comprising image data 
processing means to estimate mesh quality of the intemal discrete elements and to 
refine the unstructured mesh model based on said estimated mesh quality. 

5. The image processing system of Claim 4, wherein the unstmctured mesh 
model is a 3D mesh model with surface discrete elements composed of triangles 
(Tj), and intemal discrete elements composed of tetrahedrons (THj); or the 
unstmctured mesh model is a 2D mesh model with surface discrete elements 
composed of contour segments, and intemal discrete elements composed of 
triangles (ITj), 

6. The image processing system of Claim 5, wherein, in 3D, the intemal 
tetrahedrons (THj) are initially constracted based on the vertices of the surface 
triangles and then refined by inserting vertices either at the middle of a 
tetrahedron edge; at the middle of a tetrahedron face; at the center of a 
tetrahedron; or at the center of the circum-sphere of a tetrahedron; 

or wherein, in 2D, the intemal triangles (ITj) are initially constmcted based 
on the vertices of the contour segments and then refmed by inserting vertices 
either at the middle of a triangle edge; at the middle of a triangle face; or at the 
center of a triangle. 
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7. The image processing system of one of Claims 5 or 6, comprising: 
image data processing means to estimate a weight parameter (Lj) assigned 

to each vertex of the discrete elements based on the average of the lengths of the 
edges joining said vertex to its neighbor vertices; an optimal volume or surface 
associated to each internal discrete element, the optimal intemal discrete element 
shape being a regular tetrahedron or triangle and the real volume or surface of 
each initial intemal discrete element; and image data processing means for 
comparing the real volume or surface with respectively the optimal volume or 
surface and accordingly to initiate a refinement of an intemal discrete element 
under study if the real volume or surface of the intemal discrete element is bigger 
than its optimal volvmie or surface. 

8. The image processing system of Claim 7, comprising image data 
processing means to estimate a validity criterion according to which a new 
intemal element is valid if and only if its circum-sphere or circum-circle encloses 
no other vertex of the mesh. 

9. The image processing system of Claim 7, wherein the image data 
processing means to estimate mesh quality of the intemal discrete elements 
comprises a criterion based on the length of edges of the intemal discrete elements 
and the diameter of its circmn-sphere or circum-circle, and a criterion based on 
the volume or surface of the intemal discrete elements. 

10. The image processing system of one of Claims 1 to 9, further comprising 
visualizing means (60) for displaying processed images. 

1 1 . The image processing system of one of Claims 1 to 10, further 
comprising means for stopping the refinement of intemal discrete elements when 
a predetermined threshold of mesh quality is met. 

12. A medical imaging system comprising a suitably programmed computer 
or a special purpose processor having circuit means, which are arranged to form 
an image processing system as claimed in one of Claims 1 to 1 1 to process 
medical image data; 

13. A medical examination imaging apparatus having: 

Means to acquire a three-dimensional image of an organ of a body; and 

a system according to one of Claims 1 to 12. 
1 5. A computer program product comprising a set of instructions to be used 
in a system as claimed in one of Claims 1 to 12. 
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Abstract: 

An image processing system having image data processing means of 
segmentation of an object of interest using an unstructured deformable mesh 
model composed of siirface (Tj) and intemal (THj) discrete elements, and further 
means of refining said mesh model by automatically dynamically adapting the 
size of the intemal discrete elements to the local variation of size of the surface 
discrete elements. This system has means for acquiring size information (Lj) 
related to the surface discrete elements in order to evaluate the optimal size to be 
assigned to the intemal discrete elements and for propagating this size information 
from the surface discrete elements to the intemal discrete elements while new 
intemal discrete (THj) elements are created during the refinement process by 
insertion of new vertices inside said intemal discrete elements. 
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Constructing a 3D mesh surface S with vertices J 
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Filling volume V with tetrahedrons THj based on 4 vertices J of S ^^2k 
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Assigning Weights U to vertices J 
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Calculating optimal volume vj for tetrahedron THj 
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Calculating actual volume vrj of tetrahedron THj 
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Comparing actual volume Vrj and optimal volume Vj of THj 

Deciding refinement of THj if Vrj > Vj 
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Selecting a new vertex J in 
THj at center of THj or Oj 
or middle of face or edge 
in function of tetrahedron 
quality criterion q 



Calculating 
Weight Lj for new 
inserted vertex J 



^"^8A 



Calculating quality 
criterion q of new/ 



tetrahedrons 
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Constructing a 3D mesh surface S with vertices J 



Constructing triangles ITj based on 3 vertices J of S y^2^ 



Assigning Weights Lj to vertices J 'tNsb 
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Calculating optimal area Sj for triangle ITj 



4B 



Calculating actual area Srj of triangle ITj 
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Comparing actual area Srj and optimal area Sj of ITj ^ 
Deciding refinement ot ITj if srj > Sj 
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Selecting new vertex J in 
ITj at center of ITj or Oj or 
middle of edge, 
in function of triangle 
quality criterion q 
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Calculating 
Weight Lj for new 
inserted vertex J 



Calculating quality 
criterion q of new, 
triangles 




Refining ITj by inserting the new vertex attiie chosen location 
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FIG.2A 



FIG.2B 
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FIG.2D 
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